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Federal support for research in vocational education 
dates "from the Smith-Hughes Act of 19 17. . However', only one 
substantial study of vocational education research has beer, 
undertaken^ In 197Ur the National- Academy of Sciences*Nati?:nal 
Eesearch Council was awarded funds from the Bureau of Occupational 
and Adult Education for a two-year examination of federally supported 
vocational education research undertaken during the precediv.g deca.de- 
An eleven-memter Committee , on Vocational Education Eesearch and 
Development (COVEED) was cftosen to provide policy guidance for the 
stud 3- The cpnclusions and recommendations of 'the COVEED study fell 
into two .groups: assessment of the administration of the research and 
development program and assessment of the products of vocational 
.education research and development. In assessing products,. COVEED 
concluded that vocational education re^search has (1) added to the 
body of knowledge about vocational education and its students, (2) 
has produced new programs and classroom techniques, and (3) has 
developed many curriculum materials which have been purchased ty 
large numbers of people^. Recommendations resulting from the COVER D ^ 
lepcrt appear to have been a catalyst for change in the vocational 
education research and development process* Some changes, however, 
clearly went too. far, and several changes which COVEED recommended 
have net been implemented. (LEA) 
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■ Introduction 



Federal support for research in vocational education dates from the 
Smith-HugKes Act of 1917 (Public Law 64-347)^^hich, permit ted the states 
to^.use federal funds to conduct^^studies . Within the federal office, ..^-^ 
"much attention was given to the . preparation of manuals of instruction...^ 



•^because therWwas so, little instructional material available. The^first 

. '/ . . . . ' ' " '. . ' 

such courses of stpdy appeared in 1919 (Barlox^' 1967 , p. lAl). Among the 
"research" completed were community surveys, trade analyses, standard^ of 
.various kinds and evaluative criteria. Buf these tended to be "...a 
'secondary part of other programs. ... [Research was] not their primary objec- 
tive" (Barlow, 1967, p. 158). . • 

Vocational, .education was assigned to the U.S. Office of. Education in 
the mid-1930' s. The predecessor of USOE, the U.S. Department of Education 
was assigned in 1867 the responsibility for collecting and disseminating 
statistics about education in the states and territories. JJSOE and the .. ., 
Department of -Health, Education, and Welfare, have continued this task 

(U.S. Department of H. E.Wl , 1969) , and according to Clark (197A, p. 4) 

this represented the only significant federal "involvement in educational 



■ . *This paper has been improved by comments from Glenn Boerrxgte.r, 
Larry Braaten, Henry David,' Jim Galloway, Howard Hjelm, -H. ,C. Kazanas, 
John Klit, Ron McCage, Al Phelps, John Washburn and Tim. Went ling. . 
Errors of fact or emphasis, however, are the sole "responsibility of 



• •• ■:• . ■• , ■ .... ■■ C. 

. . ■ ■ ■ ' • i 

c ' r ■ • . . ' . • • • 

research and development prior to. the .1950^s, Certainly the Cooperative 
Research Act of 1954 (Public Law 531) represented' a major expansion of 
federal invplvemeat in educational research, and Clark. is correct in 
crediting it as a major step in educational R&D, "It was also a major 
step in vocational education RStD, • ■ ■ . . ■ 

Until the mid-1950^ s , research in .vocational education essentially 
did not exist as a .venture which was .sufficiently independent to allow 
accountabilrty. Vocational .education research was a priority area within 
"the Cooperative Education Research Branch of USOE .from 1956 to 1964, when 
the provisions of the Vocational Education Act of 1963 led to the creation 
of a special branch in USO.E for vocational educ.ation research. .The 1963 
Act. authorized (but appropriations never approached) 10 percent of federal 
vocational education funds to be used^ for research. 'One of the major 
^accomplishments under this Act was the establishment bj^ USOE of Research 
Cobrdinating Units through grantsmade to the states for research and , 
development vjork and for coordination of state-level R6tT) in vocational 
education. More than 60 percent of the federal R&D funds went to uni- 
versities, and many researchers frbm the social sciences were encouraged 
to do research in vocational education for the first time. 

•Administration of federal vocational education ' research funds was 
'almost entirely within USOE until 1969. Tne 1968 Vocational Education ^ 
Amendments (Public law 90-576) transferred 50 percent of the vocational 
education research fund to the states. Within USOE, the person in charge, 
of the remaining 50 percent has changed frequently, and the structure for 
administering research has change,! almo^u as rapidly., ..But even more. 



rapid has been the -change in research priorities, both within USOE and 
in-the Research Coordinating Units (RCU's), the state agencies which now 
receive the majority of federal research funds for vocational education 
research, demonstration and curriculum development. 

The most recent chang.e in funding (for FY 1980) further reduces 
federal funding for "projects of^ national significance," and .effectively 
earraarks a substantial portion of the remainder to the National* Center 
for Vocational Education Research., the' only federally funded survivor of 
a once-Substantial network of national and regional vocational education ' 
research .centers. Although the Secretary of H.E.W. has reversed himself 
and has asked that FY 1981 funds for "projects of' national significance" 
be restored to the. FY. 1979 level, it would appear that USOE research in 
vocational education has not been receiving oven>7helning support .pn^ 
Jthe other hand, state-operated R&D programs have generally, been treated 

- ■ , 0 . . .• ■ . ' . 

well, • . . - 

The COVERD Report . " ^• 

Only one. substantial study of vocational education researchhas been 

undertaken. ^ In. 1974, the National Academy of** Sciences-National Research. 

Council (NAS-NRC) was awarded funds 1c rom the Bureau of. Occupational and 

Adult Education, USOE, for a two-year examination of federally supported 

^ ■ ', ' ^ 

vocational education research undertaken during the preceding decade. 

The National Academy of ScTerTce's^ Congress 

to, provide independent advice to the government on sciientific matters. In 

1917 its National Research Council .was added, and in' recent years, the NRC 

■* . ■ 

Assembly of Behavioral and Social Sciences has provided counsel beyond the 



natural s.ciences and engineering, vhi*h have been the traditional areas 

of National Academy expertise • ' 

. The^NAS-NRC prides itself on; its' independence, but The price of 

that/independence is an inadequate budget which must be suppleir.ented by 

project funds.. As does any third-party evaliiator, it must offer promise 

•» • *, • 

*pf providing useful information to the funding agency, in order to secure 
iE>roject funds. But iu. order to luaintaia an;aura. of independence and to 
increase its credibility in a cynical society, it must alv;ays appear to 
be objective and increasingly it appears- to be critical of the products 

and programs it evaluates. - . ■. ' ' 

■ . ^ • . • • ' ■■ ■ i'> 

The^National Academy uses three principal methods of structuring 
reports which will be reasonably accurate and. useful but at the same time 

will continue their project-based funding and their credibility * The key 

..... ^ * 

to National Academy survival is a small cadre of continuing professional 
staff, augmented as needed, by short-term staff who do most of the actual 
project work. The continuing professional staff typically selects a 
Committee, tnade up of ...reasonably prestigious people who have some interest 
or expertise in the matter being investigated. The third element in re;jort 
, production is a series of policy and scientific review panels which must 
approve the^quality of tjie report before it can be released. 

The eleven. members of the Committee on Vocational Education Research ' 
and-De ve-lo p men t-(-eQV-ERD j^e r e-cho s e n ■ b y the NAS staf f to provide policj 
■guidance for the study of the USOE vocational< education research program. 
The study itself obviously was modeled after a then-current NAS-NRC study 
of the RScD program of..,the U.S. Department of Labor (Committee on D-0*L. 



.f- ; *' Manpowep^&D, 1975), and the chairperson of the D-O.L. Study Committee 

also served as a member of COVERD. Other "members of COVERD uere social. 

- - scientists, educationJal administrators and vocatiop^l educators. They 

represented labor uniops, public schools, universities, state education 
••■ .; •••agencies, and professional associations. They we're articulate .and kno\>;l- 



edgeable, in their specialties. ' Those who had not specialized in voca- ; , 



^; tional education sobn became knowledgeable of it, and all. contributed ..J 
measurably to the, final report. . The professional staff provided by NAS 
.was capable, and soon came to a working knowledge of vocational education. 

•They collected data and. did most of the writing. The editing and review 

process markedly strengthened the earlier drafts. 

Both the National Academy staff and COVEEID members deserve credit 
*> ■ • . . . ' • ■ . " . 

for their unselfish efforts. But even- more credit should be given ::o 

■ : - ' . . ■ ■ • ^ ; - . ; 

'Howard Hjelm, Glenn Boerrigter, Larry Braaten and Mary Marks, the four 

^ / \ • - - ' . ' ^ . .V ■ . . \ 

administrators of vocational education research in USOE. ' They funded the.' . " 

• ' ■ • ■ r '■ ' -.. ' ■ ■ ■ ^ ' ■ • ■ ' 

study, though they knew that it would be controversial, because they believed 

■» ■ ... 

that it would, improve the program bf research. They provided all of the 

■ • ^ ■ ■ . , " ' ■ * 

information they had, and they made no attempt to control the scope of 
direction of study. ^. . " .V- 

* • . *"^. ■ ; Contents of- the COVERD" Report . * 

Because there had been little systematic study of vocational education 
research, it was necessary for COVERD to generate as well as to -collect 

0 . ' ' , ■ . . ' ■ 

■ ■ . ■ ' . ■ V • 

data. Information came . from document analysis-, from interviews with re- • ■ 
searchers, research administrators and persons intended to be affected by • 
X the research, from public hearings, and from' commissioned papers prepared 



.... v>^.- 



by knowledgeable observers of «the R6D scene.. Incredible as it max,.,se^^^^^^ 
in a few' cases, the only retrievable records of research projects were 
the project title, name of the grantee or .contracto.r, and amount of the 

■ • O . " . . ■ ' - . .. .. 

award/ Although most final reports ar'a available through ^ERIC, AM' or ^ 
'Alttr (standard vocational education" document sources), other, records were 
.not retrievable from government warehouses, and there was no record .of ^ 
where or how the. final reports had been disseminated. The best records- ^ 
came from the private files of dedicated civil servants who had at one 
time or another been involved in vocatiolial education research. Because 

. , . ■ -3 . . . • . ; •. . r y 

of time and budget constraints COVERD did iiiot investigate the substantial 
amounts of vocational education R&D funded by. agencies other than USOE. 

The conclusions and recoramendations^f COVERD fell neatly into two 
groups: assessment of the adininistration of the R&D program and assess- * 
ment- of the "products of vocational education R&D. Assessment of the 
former was'mucrh easier than judgements about the latter. ; • • , 

Assessment of R&D Products ■ , . ' * ■ ■ 

COVERD concluded that "vocational education R&D has added to the body .\r^. 
of knowledge about. vocational education and its students. . .has. . .produced 
ndw programs find classroom techniques for use across the nation. ..[and] • : r 
-many^ curriculum materials have been: . -purchased by large numbors of people 
(COVERD, 1976, p-.^D- In addition researchers had been trained and in- 
stitutions for creating, and disseminating knowledge had been developed, ■ 
Recommendations for the content of vocational education R&D and for assess- 
ment. of it in tha future were quite.straightforward and . uninspired: ^; ; 

1. Study the objectives and priorities of vocational education itself. 



2. Fund longitudinal ■• studies of vocational education graduate?" and 
of comparable people who did not get vocational educatio^^ 

3. Keep copies of final reports and create research syntheses^ 

' 4. Develop a systematic, plan for formative and summative. evaluation 



of a sample of RiStD projects, . * ■ ■ /.vv ' . . ^-'j'' •■ 

r^'U:.:'^:.' Convene an advisory panel every five years tq assess vocational 

■ education ^nd vocational educatiorfil&D and to recommend changes, ..as was 



done in 1962 and 1967 (COVERD, 1976, pp- . 41-43). 
Assessment of Administration of R&D 



J ■■ 



^ The conclusions and recommendations with regard to administration of 

. ■ ■ ■ - , ' - 

. vocational . education R&D were, more numerous. The key conclusions and ^ 
recommendations .dealt with: ■ 

1<, Priorities which changed so often that cmnulatiye effects were 
difficult or impossible.. ' - • . 

2. Priorities whicli were based on bureaucratic, or po^litical consider:^ 
ations* rather than on the results of previous research. 

3. Distribu^^Sn of funds based' on geography, rather than' capability , 
.of researchers. • ^ ^ , ; 

^ ■ 4. L^ck of coordination among research, ^ demonstration , dissemination 
and -turriculum development. * ':• . 

5. Absence. of a systematic effort to assess the impact of R&D (COVERD, 
■1976, pp. 1, .2, 68-79). 

It was these^ administrative impediments imposed by the legislative 
^ and executive branches of government which COVERD believed were responsible 
for its failure to find substantial demonstrated impact of vocat.ionaL . : 
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education R&D on vocational education", students Only in curriculum.developr 
ment could COVERD find clear evidence" of impact on students, \^ . 

' . . .. . Actions Taken. Af>er the COVERD Report • \- 

\ Even before the COVERD Report, had gone through the review processes 
df ''the .National. Academy, congressional* staff .people were demanding acqe^S' 



> •". v.. . 



to its findings. ' The^ urgency was caused % congre^siohal consideration /j^*^-; * 
of the Education Amendments of :X976 (PuBlic Law 9A-A82). 'Eventually . . ! 

.Congress was given access to the draft report before it had been approved . 
by the National Academy,. ^7 ' * . 

. * ■ . L . . ' ^ " ' . .... . . O 

It is impossible To judge the extent to which the COVERD draft .and * 

■ . . . ■ ■ t, . ■ " ■ ■ ' , ■ " -■ • ■ 

final report influenced Congressional' actidns. There are .a number of ^ ■■ 

parallels between the 1976 .Amendment^ and the COV^ERD' Report, but there ^ • 

are also some marked discrepancies.. It seems likely that Congress ^accepted , 

those parts of the COVERD Report v7hicH. coincided with its previous vxev/s, 
—_-•*-• ^ * 

and rejected those parts which were in conflict. Only in a^reas where no / ■ 
Congi^essional preference existed is it likely that COVERD wa^ inf luential,_ 
Congressional Actions . . ..... V:'" *;•■:.. . 

•.COVERD recommended ,\and Congress acted on: • . ■ 

■ 1." Evaluation of vocational .education by USOE (20 USC 2312). ' ' , 

>^2. Encouragement for ^states to coordinate research, development, and 

... • • * 

curriculum development (20 USC 2351 and 2401). 

3.. Support of one or more national centers for vocational education ^ 

research (20 use 2A01) . ... ' .. ' ... 

' A. Coordination of USOE vocational education research (20 JJSC 2401 (A))- 

..... a 

5. In separate legislation, Congress authorized (and later funded) 
separate demonstration activities for Career Education. ^- . , 



^. ; Establishment of a more, r^.tional' way. qf determiirifig -research ' • 
priorities (20 use 2401 (4)). 

Establishment of a ^'Coordinating Committee o,r Research in Voca- 

i> . • . - . • . 

tidnal .Education within the. Educs^tion Division of the Department of }{.JErAK^ 
(20 use 24Q1 (4)), This Committee has three member.s: the-'Commissioner 

pf Education, -the Director of the National Institute of Education, and 

• . ■ . *j ■ ■ , . , 

the' Director of the Fund for the Improvement ' of 'Post-Secondary Education* 

... * ^ - • . ■ ■ ■ . 

(or their representatives). • It is charged with developing an annual plan • 

which '(1) Sets priorities for and coordinates the use of funds for . • 

a, research in. vocational education, career education and education and 

work, and for b. projects, in research and de^velopment, exemplary and inno- 

vative programs, and curriculum developmenjt. 

Congress acted on but COVERD did not recommend: 

1. .A requirement for contracts; (no grants allowed) for research** 

■ • ' ". . ^ ' ■ ■ ■ * ■ . . 

supportecj by State Research Coordinating Units (20 USC 2351) and f^T exem-- 

■ • .. ■■ ■ ? • . 

plary and innovative programs (20 USC 2352) and for monolingual or multi-- - 

9 ■ ' ' ■ 

lingual curriculum development. But grants can be used for projects to 
overcome sex bias (20 USC 2350, 2356) and for progrlms of nationa^ signifi- 
cance (20 use 2401) and^ for. bilingual vocational education instructional 1 
materials (20 USC 2418) and. research ^nd development (20 USC 2419). 

2. A requirement that applicants for research funds "diemonstrate a 
reasonable. probability that the contract will. ..be used in a substantial 

■ ' e' 

number of classrooms or other learning situations" within-, five years after" 
the termination date' of such contract"* (20 USC 2351, 2353 and 2401) . 



•-~3% . COVERD recoTmnenaed, greater ■ dse o'f field-initiate^ prb.posals and 
use^ where apprapriate,; of sole-source* funding. 9ut req*u*est»s for p,rop.gtsals 
s 



) virtually are ^r^'jquired by -law t:6,;,b& the'* dorainant ' r'&^earjci'h^nnqunce.- V 



ment.mbde, . ~ ' , ' . * - * " , « - * . ' • * 



USOE/HEW Activities 



Long before che' COVERD Report was . coimple ted USOE ^staff t»eg?,n t^b take 
actions^ based- -on, information being .a'ccuiaulated by COVERDV"* "By ^fehe-ti-me" the - 
Report had been completed, they had , implemented virtually evexy recommen- 

. ■ ■ ■ ■ . . ' ■ ■ : 

" . '• ,^ ■ ■ r *i ■■ . - " . ■ ^ ■ . * • 

. . ' • ff . « ■ • , « * - . ^ . 

dation whicH cduld. be'* iraplemerited without -additional funds or c6ngressibji'al_ 
approval,' Included were: J - ■ . • • 

' ' . ■ • . ' ■ ■ 3 ■ ^ 

" - . V ■ - ■ ■ . , ■ ■ . . - - 5S ■ ■ 

"1. * Longer time periods were provided,^ whenever possible^,' between tlfe 

■ ■ ' * . .• ■ ' ' ■ • . ' 

atinduncement of and the closing date for receipt of aj^ldcations fo^* . - 
research funds. (But sometimes only 30 days is-allowed between .publicatiqn^ 

of an RFP and the final dat^ for receipt of complet'e > proposals . ) ° • 

. • - • 

2. ExperimentatJ^on was begun with a two-phase compe^liition for 'research 
awards, with only the winners .pf the first phase being encouraged to 'submit;- 
full-fledged proposals. ^ ' / 

3. Steps, were taken to insure even stronger efforts to involve minori- 
ties and women in research, activicies. " ■ ^ 

4*. The management -information system on ^research activities was ' - • i ' 
strengthened. , ^ • . 

5, . The ..Curriculum Center Network. was funded at a (slightly) higher 
level". *• . ' • ■ ■ . • . ■ -\- \ 

^6. Funding of Research Coordinating Units was incr^a^ed,_particularly 
in *the smaller states. (Unfortunately; this was negated in a few states 



by decisions to use the 20 percent set aside for "program kmpfovementV for 

' ' ' * •. • • . • 

non-RCU, activities.) " . . ^ *' 



/ 



7-. The two^major information retrieval systems in vocational educatipn, 
ERICyCICE and AIM/ARM \^ere brought together. ' * ' , . 

8. The National Center was assigned: resppnsibility for analyzing and 
'assessing research information, for transmitting it to user , groups, and. ' for 
assisting them to use it. 

9. 'The eommissioiier\s share of research, funds was no longer allocated ' 
on a formula basis, and it was no longer possible for a state- department to . ' 
recommend . only ii\s :own proposals for funding, thus pre-empting all national, 
research monies forN^ that, state. ' . . " 

10. Regional office ..management of R&D funds was terminated-. ^ ' 

II- Projects aimed at translation of R&D results for cons.umers were 
being funded. 

• r-^^P There was a l^^eginning of support of research on the objectives and 
priorities of the vocational educavilon program. " - 

13. The process of impact of research in vocational -education was being " 

studied. ■ ' ** ,^ ' 

* . ■ ■ ' ■ ' . ' , ' ■■.'■.* 

"A .,.r''^But USOE- also acted or continued to act in ways that- were not recbnraiended 
■ ■ - • ' . . •' , ■ • 

'by-.^^QVERD.' " For example:. . • . ■ ' 

. 1/ .COVERD/^fecommended that the' funding* of Research toordinatine Units ■ 
be^ e?«amified' closely, r^theji- than perfunctorily,., and that their* past per-i' 
formaiice be evaluatj^^. . CerfSinly.vmost RCU's. could be 'improved ty such an 
evaluation, ^r. ' ^kf^l " ' • *• . ■ 



2.. USOE failed to ac t . ef f eclively on a C.OVERD recommendation that 
previous poor performance of a research contractor or grantee be taken 
into account in the award of new contracts (|r . grants. (USOE is not the 
oi^y government agency which has this problem.) . ' 

3. No researcher, no matter how capable, has received research awards 



from-^federal funds contiriuouslyj^r _as_JLang--aB--fri.-vjB^ears . Obviously 3 



/>r> n t -1 pi in>-y--/v£^H^:v^T*4^-fvf— I * m p^h 1 m ' r>ycnya-r-ryi p r g leaves much to be desired • - - 
The law restricts an award to a maximum of \three years, but there is'ndthing 
to prohibit a researcher receiving a renewalNof support^. In exceptional 

cases, five or six-year- awards should b!&_allowea\ by_law-, 

]A* v\TSe_pnly continuity in reseaTch_^pics_is^^ 
'in- the.:law,* e.;.gV-,.; sex equity , handicapped. Other research topics fluctuate 
.and tend to be_:emphasi^d one year, and not the next, - COVERD concluded that ' ■ 
this was -.a major cause of inefficiency. • There has been improvement, but" 
'xt rerikins a- severe ^problem. ^ .... ... 

Research Coordinating Unit Activity 

There is a national association o^ Research Coordinating -Unit directors 
whiciL^serYes important coordination, education and lobbying functions. This 
group was, of course, very interested in COVERD ^activities and p^vided use- 
ful information oto COVERD,*to the Congress and to USOE. It carefully 
reviewed the COVERD recommendations, and invited COVEEID "members and. key 
congressional staff members to . meet with, them and to explain^ the' Report , 
and reactions to it. Perhaps more than any other «agency, it was effective 
in transmitting the concerns of COVERD and of the Education Amendments of. 
1976 to the. RCU^s,. and in developing adequate responses to these concerns. 



Major ■ effects on RCU activities appear to be the following: 

1. The' Congressional requirement^'-that RCU* s eliminate grants and 

execute only contracts has caused inordinate difficulty in many states. 

Bidding procedures required by state law may make it . virtually mandatory . 

that research- contracts go. to the lowest bidder regardless of qualif icatians 



or p^'evious perf ormance. In • some cases even, a conviction* on ftaud or briber 



charges is not enough to disqualify a contractor. Inadequate performance 
On- previous research activity certainly would riot disqualify a low bidder 



T 



In^many— states. Federal^proc^fement requirements ^have been impoised on top 
of state regulations with no consideration of th'eir compatibility, and . 



~f ede-r-ai— p r o crrr ementr'T'equireineTr trs~f o r contracts a r enthems elves designed for 
the procurement of standard commodities, rather than purchasing effective 
research results. 

..2. It is now common to have competition for research awards, vjith^^'; 

little reliance on sole-source contracts except for the extension of con- 
. tracts on which. performance has been good. RCU directors point /out, however, 

that competition could and should be used in awarding grants cbmpfet^ 

and contracts are not synonymous. '^■^'^^j'f^ii:'"^ % 

* ' 3. Priorities are determined more rationally and openly ,r''^hd, once 

determined, are published. ^ 

4. . RFP^s are'used more and more frequently, but small state staffs, 
in particular, have difficulty in preparing satisfactory RFP'' s . : 

5. Advisory committees for RCU's are now the rule, rather than the 
exception. 



6. It is more common to plan the research process, seeking cumulative 
results and continiiity of effort as long as worthwhile results are being 
achieved. With the exception of the first, these changes have been generally 
beneficial. 
Researcher Activities 

1. The principal effect of the Education Amendments of 1976 on 
researchers has been %he need to specify in their proposals, how their work 
wil 1 impa c t , c las s r o oms o r other learnin g sit es wij:hjtn^lve— years^, — In— mo s-t- — 
cases this is relatively easy to do, and it has had the. beneficial effect 
of forcing the. researcher to, think seriously about dissemination activities. 
But in other cases, it is difficult or impossible to expect a high -proba- v 
bility.of impact within five years. 

All high^-risk research, by definition, has a relatively low prospect 
of impact, but if it combines a probability of high payoff with hig];i risk, 
it may. be a far more reasonable investment of research funds -than is the 
typical low-risk, low. payoff study for which it is easy to specify iqipact 
(but inconsequential impact) on classrooms. In any' case, the goal should' 
be for the "research prpgram , not each of its projects, to have impact on 
classrooms and other teaching-learning situations. * ; 

Where did the ^five-y ear 'figure come from? No one seems to know, but 
it seems to have no empirical base. Possibly it came from the five-year- 
duration of the Act. . The best of the recent' studies of impact of techno- 
logical research indicate, .an average of more thav'^ "two decades from discovery 
.to application, and further notes that this average has not been declining, 
contrary to conventional wisdom (Batelle, 1973 and IITRI, 1968). durrent 



research in Illinois "indicates that one of the reasons for lack of research.. 

« "... . ■ 

impact.is high teacher turnover. In many vocational programs, especially 

. ■ ■ • ■ p. . ' ' ■■ , 

for "adultSf. the "average teacher tenure is less' than five years. 

2. Another major effect on researchers has been the need to chase 

• • . ' ' - ■ r_ . 

RFP^s". This" is related directly to the" de~emphasis on researcher-initiated 

proposals and the emphaiiis on RFP's. Even if a researcher proposes a study. 

* '• ■ 

which becomes an RFP, the researcher may be disqualified from bidding on 

/■' ■ ■ • . _ _ ' ■ ■ ' _ 

the contract because of a "conflict of interest 1" 

: It seems likely that there, are ' more good ideas for research in the 

research community than are likely to emerge from sole reliance on RFP's 

prepared by overworked research- administrators who write RFP's at home 

because, their of f ice duties don' t allow time for this important-activity. 

A principal reason why administrators lack time to write good RFP's is^that 

they .are forced to spend so- much time on--. the mandated RFP competition and. 

procurement process. 

■ ■ 0 - ■ ■ ■ 

3. Lack of continuity in research as a result of chasing RFP's on 
varied subjects seems, to be directly related to a lack of cumulative 'research 
results. It takes time to get a research project under way in an area wi-th 
,which .the researcher has not been intimately involved. . It is common for 

six months to be spent in understanding the. previous res'earch in t"he field. 
At'Vabout the time this is mastered, it is time to respond to a new RFP, wiiile 
trying to make some substantive progress on the . current, project. By the time 
the current project is finished, it is time to study the previous research in 
the-'new area. No wonder research is not cumulative and that the impact of 
last year's work is not studied. ' 



Activities of Research Users 



Little concrete evidence cduld be found of changes in the activities 
of research users, but it would [appear that they are: 

!• More likely now, than in the past.* to be asked to serve on advisory 

« 0 

committees, respond to questionnaires, or be interviewed about their needs 
for research products, " 



2. Being asked more frequently to try put and^ to .evaluate -research 
products. ^ 

3. Being asked more frequently about where they secured the ideas for 
changes they aire making. 

■Recommendations of COVERD Not Acted Upon 

1. At least 20 percent of research, development and curriculum funds 
should vbe devoted to research, defined as a search for new knowledge,. 

2. A national commission should be. convened . each five years to recom- 
mend changes in vocational education as the Willis Commission and the Essex 
Commission did in 1963 and 1968, respectively. ' 

3. Some states have still not. reorganized their Researcli Coordinating 
Units to give them responsibility for both research and development.' 

, ^ . Summary ■ ■ ■ ' 

The- COVERD. Report appears to have ibeen a catalyst for change in the 
vocational education research and development process. In retrospect, most 
of these changes appear to have been desirable. Some changes, however, 
clearly 'went' too far, and several changes which COVERD re'fcommended have ^' 
not been Implemented. These changes appear even more desirable now. than 
they did in' 1976, and are' repeated as part of the following recommendations. 



Re c ommend a t ion " 

1. . Needed changes in Public Law 94-482^ Education Ainendments of 1976 
' >a. Change Subpart 3, Section 131(a) and Section 133(a) to allow 
states to use both grants and contracts. Require State Advisory 



Xouncils to review and comment on grant" and contract procedures. 

Chaiige-Subpa-iit— 3^-^ec^t~ion~l-3-l-( b -)-and~S e c t-ion— l-33-(-b-) -t o-eiimi-- 

nate the requirement that each project> thave a reasonable probability 
of use in* classrooms or other learning situations within five years. 

■ \ . ' • ' • : . , ■ ■ V ■ ■ -■ 

Substitute a requirement: ^ 

(1) . For a biennial report of the impact of the state*s 
research, development, and curriculum development program on 
efficient use of public vocational education funds; 

(2) . That each. project specify its expected impact on voca- 
tional education, the timers) when this . iiilpac^ is expected to . 
occur, the steps to be taken to increase 'the probability of this 
impact, and a suggested strategy for monitoring., and assessing 
project impact. / - ] 
c. Change Subpart 2, Section 171(a) should be changed to allow 

the Commiss'^ioner to use both grants and contracts . It now says 
"primarily for contracts "and in some cases for grants." Because the 
National Center is funded by a grant, and because this is the largest 
expenditure ynder this sectiori, other grants are virtually forbidden. 
•Both grants and contracts are needed. The National' Advisory Council 

on Vocational ^Education should review and comment on grant and contract 

,' ■ • ^ ■ • ' . ' ■ 

procedures. ' • . 



2; " Needed~Chang^^^ Administration of Vocational 

Education Research and Development 

a. Allow at least half of the budget of the National Center for 
. Vocational Education Research to be spent on projects designed or 
--approved by the Center Staff and its Advisory Committee, with . no 
<^o^t^Ql-j^^em^^ . ^ ■ , _„ .. ■ 



b. Reserve a substaiitial portion of Programs of National Signifi- 
cance funds (including National Center funds) for competition among 
proposals initiated from 'the field (not in response to Requests for 

. Proposals). Federal regulations probably would require that these be^'^^ 
awa:^ded .as grants, rather than contracts, even though there would be 
competition among all of the proposals . submitted from. the field. 

c. Initiate a study tb determine why higher education institutions 
are receiving a' declining share and why private .consulting firms, are 
receiving an increasing share of research- projects. Obyiously,- pror 

.posals from the. latter must look better. Wliy? The conventional wisdom 
is that universities do better. in getting grants and that profit-making 
groups do better on, contracts. Why? How can proposals from both groups 

■be' improved?. How can the match between proposals and results be improved 

d. Institute a competitive small grants program for doctoral disser- 
tations patterned after the "New Researcher" program of the Department 

of Labor .and the "Student Research" program of the Bureau of Education 
for the Handicapped. 

e. At one '^time the ^Federal research program had an' excellent 
procedure, of competition among preliminary proposals, followed by full- 
fledged proposals from the uinners of the preliminary competition. 



This was dropped because federal procurenient regulations permit it ^ 
only, for grants, not for: contracts, , It is still used by some state. 
RCU's in spite of the federal regulations;, and it should be used more 
widely. Guidelines describing successful RCU strategies for these 
-two-phase competitions ..should be developed and disseminated. 



f~. Research needs are surveyed every year "by USOE, Presumably . 

USOE research priorities are based, on these studies of needs. The' 

•identified research needs are essentially the same in each survey, 

but priorities change markedly from year to year, A study should be" 

made bf this anomaly. What , besides surveyed needs, affects research 

■ . ' . *» ■ 

priorities?, * - 

Re-institute anonymous ireviews by mail for medium and small 
project proposals instead of convening panels in Washington.' Washingtoi 
panels^aiie so expensive^ and time consuming that * they of ten ,can not give 
enough attention to each^of^..the^large numbers of proposals they review. 

h. Instead of constituting virtuaTly^^vexy-^re.^ proposal 
review panelwith a Itoken Black arid Hispanic, and half or more^wdmeay^ 
establish a pool of qualified people, with proportionate minority group 
representatioTi and select panel members with needed expertise from the 
pool. If the trends in the present system continue, the panels will 
need to be doubled in s^ize just to include pressure groups that demand 
representation. . . 

i. When re1>iew. panels are convened in. Washington they normally 
work from approximately 9am to 5pm. Then they return to their hotel 
rooms to wait for 9am. Until recent yeiars,' they- would have sp~6nt their 



• . J ■ ; , ; „:__20.„. \ 

evenings reading research proposals, but now the proposals are locked 
in a vault overnight. Why? Apparently this is required by procure- 
ment regulations, allegedly to prevent collusion amono panel members 
as to which proposals were to be recommended for funding. How this 

is prevented by-JLocking- up—the^-^proposals— is-not--^t— all—clear..^ — Perhaps 

/ ■ . • ^ _^ ^ '. : • — 

— : : '■ ' ' \ . - ' • /•• 

it was designed to protect the civil servant panel members from being 

worked overtime, but almost all out-of-town panel members ^g^se that - 

the result is a waste of their time. . 

j. Employ researchers to ciraft Requests^ for Proposals (RFP's) and 
allow them to bid on their own RFP.'s. At present, most RFP's are 
drafted by a small number of civil servants who do not have enough 
time for this activity, and the quality of RFP is- affected by the 
•time and perhaps by the small number of people involved. It is assumed 
that if an RFP is . prepared by a' researcher, this provides that person 
an inside traqk in the bidding. However.,, if draft RFP's. were to be 
revised by civil servants to make sure no individual or organization 
±s favored, and if adequate time is allowed for dissemination and 
response to the revised REP, there would be no advantage to the person 
who drafted it. And, the quality of RFP's' would certainly improve.. 
Further improvement could be achieved by awarding two or three grants 
to develop an RFP for each major priority, with USOE selecting the 
best .elements from each grantor's product. 

k. Awards of contracts and grants for R&D in vocational' education 
are normally made without consideration of past performance of the^. 
contracts or grantees. Only when there is an iron-clad case of non- ■ 
performance is the contractor hampered. Review pianels which recommend 



action on awards are unaware of past problems (and perhaps • should be. 
unaware.) But it is undeniable that contractors who regularly have 
done lesS'than satisfactory work keep on getting research contracts 
simply because they hire good proposal writers. , . 

3. Needed Changes in State Level Admnistration_Q£_yjDjci.atlona3 Education- 



Research and Development . • * ■ ■ 

As a result of the Education Amendments o^f 1976, state-level admini- 
stration of research^ development, and. curriculum development programs has 
been much better coordinated. In most states, these three are administered 
by the same person. ^ This .appears to' produce considerably better' results 
than does a. coordinating committee. Still better results, are achieved in' 

or 

the few states which place research, development, curriculum development 
and personnel development under the same administrator, R&D is most effective 
when it affects personnel development programs, but conversely, if R&D is- 
hampered Ky the unavailability of specialists, the personnel development.** 
program can be modified to produce them, •. c ' 

4, Need to Establish .a Commission to Recommend Changes in Vocational . 
Education. • . - 

COVERD recommended that each five years, a federal cpmmissipn be con- • 
vened to make recommendations - for legisNlative and administrative changes in, 
federally supported vocational education programs. The Commissions- in 1963 
and 1968 resulted in substantial improvements, in and redirection of voca'r 
tional education. It is now ten years sincie the Essex Commission completed 
its work, and another study. of vocational education is clearly due, COVERD 
and the NIE study of vocational education are not sufficient, in^ the former - 



case, because it looked only .at R&D, and in the latter case because it is . 
•conducted by a government agency. whose, head once announced publicly an . ' - - 
intent, to take over administration of a portion of the Bureau of Occupational 
and Adult Education. \^at is needed is a- nonpartisan, nongovernmental, blue-, 
-ribbon commission which can examine all of , vocational education ^with no pre- 



conceived notfiohs. If such a commission had been established in tim'e, it 
could have planned the COVERD and NPE studied. Since this was not done, .^^ 
^e best time would be immediately on completion of the NIE study. ^ The NIE 

■ . ■■ ' ■■ - ■ ' ' ' ■ . • ■ 

results should be invaluable in guiding the work of the commission..^ 
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